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1.  imoDocnoi 


Th«  rcgamrativa  riathod  la  a  oathautically  rigoroua  proeadura  Cor 
obcainlng  confldanea  Incarvals  Cor  acaady  ataca  paraaacara.  In  ordar  to 
proparly  aaaaaa  cha  raganaraciva  aathod,  it  la  nacaaaary  co  dlacuaa  thoaa 
charaecarlatlca  Chat  aaka  a  conCldanca  Incarval  “good.” 

2.  QOdLiTgmg  snociDis  or  ooHnoiga  insirALS 

Given  a  paramacer  p  ,  a  conCldanca  Incarval  Cor  (x  la  ganarally  basad 
on  a  Halt  chaoraa  oC  cha  Cora 


(2.1) 


(r^.  -  n)/v^  ^  L 


aa  c  >  <•  ,  whara  L  la  a  Clnlca  r.v.  with  a  conclnuoua  dlacrlbuclon 
Cuneclon;  cha  paraaacar  c  aaaauraa  cha  alaulaclon  aCCorc  raqulrad  co  obtain 
r^  and  v^  .  Tha  procaaaaa  r^  and  v^  will  ba  callad  a  point  aatlaata 
(Cor  p)  and  a  noraallalng  procaaa.  raapacclvaly;  wa  ahall  alwaya  aaauaa  v^ 
la  poalclva.  To  obtain  an  approxlaaca  100  (1  -*  ct)X  conCldanca  Incarval  Cor 
4,  solace  such  chat  p{Zj  £  ^  £  ^2^  *  1  a  .  Than,  Cor  large  c  , 


(2.2) 


-  Vt» 


^  * 


*1^J 


concalna  4  wlch  probablllcy  1  -  a  .  Tha  Collowlng  hierarchy  of  propartlaa 
largely  dacaralnaa  cha  quality  oC  cha  conCldanca  Incarval. 


a. )  conalatancy  of  r^ ;  1C  r^  la  not  conalacanc,  v^  doaa  not  cand  co 

aero,  and  confidence  Incarval  half-langch  doaa  noc  ahrlnk  co  zero 
with  Increaalng  c. 

b. )  aavotocie  naan  aquara  error  of  r^;  In  general,  r^  la 

aaynpeocleally  noraal.  Than,  chara  axlaca  a  non>nagaclva  o  auch 


(2.3) 


-  H)  ^  oM(0,l)  . 


Squaring  and  taking  •xpaetatlona  through  (2.3),  v  obsarva  that 
2 

MSB  (r.^)  ~  o  /t  .  Conaaquantly,  ona  wanta  to  chooaa  so  that  a 

la  aa  aaall  aa  poaalble. 

c. )  axpactad  half-width  of  confldenca  Intarval;  by  (2.2),  the  expected 

half-width  of  the  confidence  Interval  la  ^*2  ~  general 

1/2 

when  asymptotic  normality  holds,  (Z2  **  ~  (Z2  -  z^)v/c  for 

some  V  ;  the  goal  la  to  minimize  v  . 

d. )  variability  of  half-width  of  confidence  Interval;  the  variance  of 

the  half-width  is  given  by  (Z2  -  z^  var  v^  .  Under  quite  general. 

2  2 

conditions,  (>2  “  ~^‘2  **  *1^ 

minimize  a  . 

a.)  approximation  error;  Let  •  jP{*j  <  “  l*)/^^  <  *2^ 

-  P(r|^  £  L.<  Z2}  I  be  the  coverage  error  for  the  confidence  Interval 

1/2 

Berry-Esseen  considerations  suggest  that.  In  general,  ~  p/t  ; 
minimization  of  p  la  desirable. 


Loosely  speaking,  a  regenerative  process  Is  one  which  looks  like  a 
sequence  of  ladependeat  and  Identically  distributed  (l.l.d.)  r.v.'s,  when 
viewed  on  an  appropriate  random  time  scale,  (tore  precisely, 

X  >  {X(t)  :  t  ^  0)  Is  a  regenerative  process  with  regeneration  times 
0  *  1q  <  T|  <  ...  If  {X|^,  X(a)  :  ^  •  <  Is  a  sequence  of  l.l.d. 

random  elements,  where  x,,  *  T,,  -  T,._,  .  For  examples  of  such  processes,  see 


Crane  and  Laaoine  (1977).  Given  a  reel-valued  function  defined  on  the  acate 
apace  of  Z  > 

.  t 

(3.1)  't  “  t  ^  f(X(a))de  ♦  r  a.a. 

0 

under  aild  aaeuapclone  on  X  and  f  .  The  goal  of  a  steady  state  slaulatlon 
is  to  produce  confidence  Intervals  for  r  . 


If 


ll(t)  ■  oax  (k  0  :  ^  t) 


and 


-  /  ^  f(X(s»ds  , 


then 

(3.2) 


*  ^W(t)^S(t) 


where  Y  .  r  are  the  saaple  asaas  at  the  Y. * s  and 
no  1 

ly.  Regenerative  structure  ensures  thet  ((T^,  t^)  :  i  >,  1}  is  a  sequence 
of  l.i.d.  randoa  vectors,  so  that  (3.1)  and  (3.2)  together  suggest  that 
r  •  ETj/EXj  .  Then,  by  (3.2), 

't  -  '  “  Si(t)'%<t) 

where  2^  *  ^  ^  ***“  ***<*•  Standard  central  Halt  theory  arguaents 

prove  that 

t^^^r^  -  r)  -♦  oii(0,l) 
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w(Mr«  a  ^  o  (2j)/BTj  <  if  E(Yj  •*>  tp  <  •  .  Furthermore, 

"t’o  "I  - 


•i  ■  3^  J  <’1  - 

i-1 


Ue  conclude  Chet 


(r^  -  r)/v^  ^  N(0,l) 

where  nomellzlng  process  for  the  regenerative 

method.  The  qualitative  structure  of  the  regenerative  confidence  Interval  can 
be  summarized  as  follows: 

a. )  r^  Is  consistent  for  r  , 

2 

b. )  MSE(r^)  ~  (a  (zp/Erp/t  (note  that  any  confidence  Interval  method 

using  the  sample  mean  r^  as  a  point  estimate  will  have  the  same 
MSE), 

c. )  t*2“*l^®'^t  ~  2s(«)o(Ep/(Etj»t)^^^,  where  t(«)  solves 

P{N(0,l)  <  s(a)}  -  1  -  «/2  , 

d. )  tCZj  -  zp^var  v^  ♦  0  (In  fact,  (z^-sp^var  v^  ~  a^/t^,  see  GLYNN 

and  IGLEHABT  (1984)), 

e. )  8  !•  currently  unknown. 


Note  that  8  Is  a  reflection  of  approximation  error  due  to  the  bias  of 
r  and  skewness/kurtosls  effects.  It  Is  to  be  anticipated  that  the  1.1. d. 


scruccur*  associated  with  the  regenerative  viewpoint  can  be  used  to  reduce 
these  errors.  For  exsaple,  MEKETOM  and  HEIDELBERGER  (1982)  developed  a  point 
estioate  which  is  asyaptotically  equivalent  to  r^  ,  but  which  significantly 
reduces  bias.  Also.  GLYNN  (1982)  proposed  a  procedure  for  reducing  8  in  the 
closely  related  problem  of  estimating  r  on  the  time  scale  of  regenerative 
cycles. 

As  discussed  above,  the  regenerative  method  is  a  theoretically  sound 
procedure  for  the  steady  state  confidence  interval  problem.  The  main 
advantages  of  the  method  are: 


2  2 

i.)  its  good  asymptotic  properties  (for  example,  a  (v  )  ■  0(l/t  ) 

indicates  the  accurate  "variance  constant  estimation"  possible  with, 
the  regenerative  method), 

ii.)  the  ability  to  make  small-sample  corrections  to  reduce  approximation 
error, 

ill.)  the  i.i.d.  structure  allows  one  to  develop  procedures  for  a  host  of 

other  estimation  problems  (e.g.  comparison  of  stochastic  systems;  see 
HEIDELBERGER  and  IGLEHART  (1979)), 

Iv.)  no  prior  parameters  are  needed  as  input  for  the  method,  other  than 
run  length. 


The  main  disadvantages  of  the  method  are: 


i.)  the  requirement  to  identify  regeneration  times  means  that  the  method 
is  hard  to  "black  box", 

ii.)  the  method  may  behave  unsatisfactorily  if  the  expected  time  between 
regenerations  is  long.  (Estimation  of  parameters  for  such  simula¬ 
tions  is  likely  to  be  difficult  using  any  method.) 


Preparation  of  this  paper  was  supported  by  the  U.S.  Army  Research  office 
under  Contract  OAAC29-8A-K-0030  and  the  National  Science  Foundation  under 
Grant  NSF  HCS-8203483. 
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